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NON-LINEAR  RENEWAL  THEORY  FOR  LATTICE  RANDOM  WALKS 


1.  Introduction 


Let  {X  }  . ,  be  lid  with  mean  \i  >  0  and  variance  o  <  “, 
n  n>l 

S  -  E®  ,  X.,  and  Z  ■  S  +  C  ,  where  5  is ,  for  each  n ,  independent 
n  j*l  j  n  n  n  n 

of  the  sequence  xn+i*xn+2'“‘  *  Under  various  assumptions  concerning 

the  nature  of  the  process  {£  },  Lai  and  Siegmund  (  [l] ,  [2])  developed 

n 

a  "renewal  theory"  for  {Z  }  and  demonstrated  its  usefulness  in 

tl 

sequential  statistical  analysis.  Their  results,  however,  were 


derived  under  the  standing  assumption  that  the  random  walk  {SR}  be 
nonlattice;  this  is  sometimes  troublesome  in  statistical  problems 
where  discrete  data  is  involved. 

The  purpose  of  this  note  is  to  state  the  appropriate  ana¬ 
logues  of  the  Lal-Slegmund  results  for  the  case  of  a  lattice  walk 
{Sn)n>1  and  indicate  briefly  how  their  proofs  should  be  modified. 

A  special  case  of  one  of  these  results  (Theorem  1)  was  recently 
obtained  by  Hagwood  and  Woodroofe  ([l])  via  a  rather  different 
approach;  however,  for  the  purposes  of  sequential  statistics,  the 
more  useful  result  would  seem  to  be  Theorem  3,  which  gives  precise 
information  concerning  the  hitting  times  involved. 

Acknowledgement.  The  author  has  had  illuminating  conversa¬ 
tions  with  D.  Siegmund  and  M.  Woodroofe  on  the  subject  of  renewal 


theory . 


2.  Statement  of  Results 


We  will  assume  throughout  that  the  walk  {S^}  Is  supported  by 
the  lattice  h.  2,  and  also  that 

(1)  E„  5 

where  the  limit  random  variable  £  has  a  continuous  distribution 
function.  (It  is  easy  to  find  counterexamples  to  Theorems  1  and  3 
when  the  distribution  of  £  has  discontinuities:  for  example,  when  £ 

n 

oscillates  between  +  £  and  -  £  for  some  sequence  £  +  0.)  In  addi- 

n  n  n 

tion  we  will  use  the  following  notations  and  conventions: 

(2)  T  *  T  *  min{n  :  Z  >  a) 

a  n 

T.  *  min(n  :  S  >  0) 

+  n 

g(k)  -  [ES  J"1  P(S  >hk)  ;  k  -  1,2,... 

+  T+ 

G(x)  -  z£*/h  3  g(k)  ;  x  >  0 
Gy(x)  -  G(x  +  y)  ;  0  <  y  <  h 

Hy(x)  ■  ^e2  P(kh  +  y  <  £  <  kh  +y  +  x)  ;  0  <  x,y  £  h 

THEOREM  1:  Assume  that  for  some  5,  1/2  <  S  <  1, 

(3)  a'^T^y'1  a)-^0 

and  that  for  each  r)  >  0  there  exists  p  >  0  for  which 


(4) 


P{max 


4lerg>n)-o  . 


n<J<n+2pn 

Then  for  all  x,y,t  such  that  0  <  x,y  <  h  and  teR,  and  each 
k  c {0)1| 2| * • *  } i 


(5) 


P(kh  <  Z_  -a<kh+x)  H  (x)-g(k  +  l) 
a  y 


as  a  ■+■  »  through  the  coset  y  +  hi.  Furthermore,  as  a  -*•  «  through  R, 

(6)  P(T  <  ay_l  +  tCTy"3/2  a1/2}  -*•  $(t)  . 

a  — 

(♦  is  the  standardized  Gaussian  distribution  function.)  If  in  addi¬ 
tion  to  the  previous  assumptions 


(7) 


P(€  <y  ;  <s  -np)/n1/2  o<&>}  ♦  f(y,co) 


for  some  tvo-dlmensional  distrlbuion  function  ¥,  then 


(8) 


p{kh<  Z_  -  a  <  kh  +  x  ;  T  <  ay-1  +  tcry~3/2  a1/2} 


g(k  +  1)  Z 
j€I 


df(?,C) 
j+y<5<J+y+x;  C>-t) 


as  a  +  ®  through  y  +  hi. 

It  is  worth  noting  that,  in  contrast  to  the  nonlattice  case, 

the  extra  condition  (7)  is  essential  to  the  joint  convergence  of 

(ZT  -a)  and  (T#  -  ay-1)/a1^2.  Moreover,  (Z_  -a)  and  (Ta-ap  1)/a1^2 
a  a  * 

will  in  general  be  asymptotically  independent  only  when  5n  and 

1/2 

(Sn~np)/n  o  are  asymptotically  Independent:  that  is,  if 
t(y,w)  -  P{?<y}  ’♦(t),  then 


3 


(9) 


p{kh  <  Z_  -a<kh  +  x  ;  T  <  ay"1  +  toy"3/2  a1/2} 

1  3 

a 

g(k  +  l)Hy  (x)$(t) 

1/2 

In  many  applications,  and  (Sn-np)/n  o  will  be  highly  dependent 

2 

(in  fact,  £  is  often  a  constant  multiple  of  (S  -  ny)  /n)  and  so  a 
n  » 

limit  distribution  somewhat  different  from  that  given  in  (9)  will 
occur. 

The  analogue  of  Blackwell's  Theorem  for  the  process  { is 
amusing  in  that  the  limit  is  not  a  Haar  measure. 

THEOREM  2:  Suppose  in  addition  to  (1)  that  there  exists  6,  1/2 
1/2  <  6  <  1,  such  that  the  following  three  conditions  hold: 

do)  e|x1|2/6  <  ® 

(11)  for  each  €  >  0  E~  P{|cJ  > n6  €>  <  ® 
and  for  each  6  >  0  there  exists  p  >  0  such  that 

n4pn^ 

(12)  E  P{|C, -S_|  >€)  0  as  n  -*■  »  . 

j-n  3 

Then  for  each  x,y  such  that  0  <  x,y  <  h, 

(13)  E?P(a<Z  <  a  +  x)  ♦  H(x)/»j 

i  n  —  y 

as  a  ■*  »  through  the  coset  y  +  hJT. 

Next  we  give  an  asymptotic  expansion  of  ET#. 


4 


THEOREM  3:  Assume  for  soae  n  >  0 


(14)  p{T<na)  -o(a"1)  ,  a  «  , 

and  alao  that  the  aequence  (Cn)  aatisfies 

(15)  l  Pfaup  k'6|Cj  >€}  <  -  ,  €  >  0 

n  k>n  * 

(16)  l  .  P{|5,  -£j!€)  ♦  0  aa  n  -►  « 

n<J<n+n  3 

(17)  (max  . | ^ . | }  ^ .  ia  uniformly  integrable  . 

n<J<n+n°  3  - 

Then  as  a  +  *  through  y  +  hi,  0  <  y  <_  h, 

(18)  PET  -  a  -  EC  +  (ES*  /2ES  )  -  h 

a  x+ 

+  x  Hy(dx)  +  o(l)  . 

Random  processes  of  the  form  Z  ■  S  +  C  and  stopping  rules 

n  n  n 

of  the  genre  T  •  mln(n  :  zn>aJ  occur  frequently  in  sequential  statis¬ 
tical  analysis.  An  Important  class  of  such  processes  is  given  by 

(19)  Zn  -  ng(Yn) 

where  Y  -  (Y,  +...+Y  )/n;  Y,  ,...,Y  ....  la  an  ild  sequence  of 
n  l  n  l  n 

1  2 

p-dlmenslonal  random  vectors;  and  g  :  fP  F  ia  a  C  function  with 

the  property  g(EY^)  >  0.  Expanding  g  in  a  2-term  Taylor  series  about 

EY, ,  we  find  that  Z  »  S  +  C  for  a  random  walk  S  drifting  to  +  • 
l  n  n  n  n 

and  a  sequence  Cfl  converging  in  law  to  a  continuous  distribution 


5 


2 

(namely  a  weighted  sum  of  independent  Xj  variables) . 

EXAMPLE:  Let  Y, . Y  ....  be  iid  with  P(Y  -  l}  *  p  -  1  -  P{Y  -  0) 

In  j  t 

for  0  <  p  <  1.  In  order  to  estimate  log(p/q)  by  an  estimator  with 
preassigned  variance  a  \  Robbins  and  Siegmund  [  4 ]  defined  the  stop¬ 
ping  rule 

(20)  T  »  minfn  :  $  •  (n  -  3  )  >  na) 

a  n  n 


where  3  *  Y,  +  . . .  +  Y  ,  and  proposed  the  estimator 
n  1  n’  r 

(21)  log[(3T  +l/2)/(Ta-3T  +1/2)]  . 

a  a 


They  showed  that  as  a  -*■  «  this  estimator  is  asymptotically  normal 

with  mean  log  (p/(l-p))  and  variance  -  1/a  regardless  of  p,  and  that 

E  T  -  a/p(l-p).  Subsequently,  Siegmund  [  6  1  noted  that  as  a  conse- 
P  a 

quence  of  the  nonlinear  renewal  theory  for  nonlattice  walks, 

(22)  p(l  -  p)E  T  -  a  +  (2p-l)2/2  +  p(l-p)/2  +  o(l) 

P 

2 

as  a  -*■  <*>,  provided  [p/(l-p)]  is  irrational.  It  now  follows  from 

2  2 

our  Theorem  3  that  if  [p/ ( 1  —  p)  ]  is  rational,  [p/(l-p)]  ■  r/h  in 

lowest  terms,  then 


(23)  p(l  -  p)E  T  -  a  +  (l-2p)2/2  +  p(l-p)/2 
P  ® 


-f 


2.-1 

q  h 

L 

u"0  ke? 


as  a  -*■  “  through  y  +  hJT ;  here  -£ 


P(kq2h  *  +  y<S<.kq^h  * +  y +  u)du+ o(l) 


6 


3.  Proof  of  Theorem  1 

We  will  present  a  complete  proof  only  for  Theorem  1.  Theorem 
3  follows  from  Theorem  1  via  Wald's  Identity: 

yETa  -  ESt 

a 


-  a  +  E(Zt  -  a)  -  E£t  . 
a  a 

* 

The  assumption  £  - ►  £  suggests  E£  -►  E£,  and  Theorem  1  leads  one 

n  T 

a 

to  hope  that 

11m  E(Z  -a) 
a-*00  a 

aey+hJf 

exists  and  Is  the  mean  of  the  limiting  distribution  recorded  in  (5) . 
The  details  of  this  argument  are  so  similar  to  those  given  in  Theorem 
3  of  Lai  and  Siegmund  [  3 ]  that  we  omit  them. 

Theorem  2  requires  considerably  more  care.  However,  a  proof 
can  be  distilled  from  the  ideas  contained  in  the  proof  of  Theorem  1 
and  in  the  papers  of  Lai  and  Siegmund,  so  we  refrain  from  presenting 
it. 

We  will  assume  for  the  proof  of  Theorem  1  that  the  span  h  of 

the  lattice  supporting  the  random  walk  {Sn)  is  1.  Now  the  assumption 
“5  “1  P 

a  (T  -  ay  )  ■- — »  0  implies  that  there  is  a  function  p(a)  1  0  as 

d 

a  •  such  that 

(24)  P(a"6|T  -ay_1|  >p(a)}  0  . 

A 


7 


53SSH 


We  are  certainly  free  to  let  p(a)  4-  0  as  slowly  as  we  like;  thus  we 
will  assume 

(25)  p(a)a^  -*■  ®  . 

Define 

(26)  nQ  -  nQ(a)  =  £  ay  1-p(a)a<S  3 

T  =  min{n  >  n.  (a)  :  S  +  5  >  a) 

a  u  n  n* 


LEMMA  1:  Under  the  conditions  (1),  (3),  and  (4), 

(27)  P(T  }  -»•  0 

a  a 


and  for  every  n  >  0 


(28) 


PtlZT  -SX  >">*»  • 


•  V  Un 

a  a  0 


PROOF:  Lemma  3  below  guarantees  that  p(t  t  [n_,  n.+2p(a)a  ]}  -*■  0. 

3  U  U 

On  the  event  e  [nQ,  n^+2p(a)a  ], 

'V  W**1 '  1 W^1 

-  max  ~  I 

tiQ<j£n0+2p  (a)  a  J  n0 
and  since  p(a)  +  0,  assumption  (4)  Implies 

P{max  ,\i  -  £  1  >n)  °  . 

n£)<J<n0+2p(a)a  J  n0 


This  proves  (28). 
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Next,  fix  l)  >  0;  then 


{Ta  t  Tfl}  c  {T  &t  [nQ,  nQ  +  2p(a)a<S]} 


U  (ra|{  [nQ,  nQ+2p(a)afi]} 


U  (max  f  I ~  €_  !  >H> 

ng<j<n0+2p(a)a  J  0 

J* 

U  (a  n  e  [nQ,  ng  +  2p(a)a  ]  : 


S  +  £  eta-2n,a  +  2n]}  . 

n  n_ 


* 

By  (24)  P{Tatf  [nQ,  nQ  +  2p(a)a  ]}  -*■  0;  by  Lemma  3, 

t>  1 

p{ra^  [nQ,  nQ  +  2p(a)a0]}  -*■  0  and  P{ane[nQ,  nQ  +  2p(a)a 

S  +  £  e  [a-  2n,  a+  2nl)  is  small  if  a  is  large  and  n 
n  nQ 

assumption  (4),  P{max  *!£.-£  |  >n)  -*■  0. 

n^j<nn+2p(a)a  J  n0 
(27).  ^ 


The  objective  now  will  be  to  show  that  (S^  +  ^ 

a 

limiting  distribution  advertised  in  (5).  Before  doing 
a  useful  result  fr^m  standard  renewal  theory. 


LEMMA  2:  Let  v  ■  v  ”  min(n  :  S  > a)  and  let  ye  (0,1]. 
a  n 

through  y  +  2, 

(29)  P(S  -  a  <  x  ;  va  <  ap-1 +  toy“3/2  a1/2} 

a 

-*■  $(t)G^(x) 

for  all  x  >  0,  and  all  t  e  F. 


]  : 

small;  and  by 
This  proves 

-  a)  has  the 

Lo 

so,  we  recall 

Then  as  a  “ 
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For  a  proof  of  this  result  see  Siegmund  [5]. 


LEMMA  3:  For  all  x,y  with  0  <  x,y  £  1,  and  each  ke{0,l,2,...  },  if 
(1)  holds,  then 

(30)  P(S  +  £  -a  e  (k,  k  +  x]}  -*■  H  (x)g(k+l) 

Ta  V  '  y 

as  a  ■>  00  through  y  +  2%  Moreover, 

—1  —3/2  1/2 

(31)  p{t  £ay  +  tap  a  }  $(t)  as  a  -*•  00  , 

a 

and  for  all  €  >  0  there  is  an  A  =  A(£)  and  n  =  h(6)  >  0  such  that 
a  >  A  implies 

(32)  P{s  +  £  e  [a-n,  a+n]  for  some  n  >  n_(a)}  <  €  . 

n  nQ  0 

Finally,  if  (7)  holds,  then  for  x,ye(0,l]  and  ke  (0,1,2,...  }, 

1  3/2  1/2 

(33)  P(k  <  S  +  £  -  a  <  k  +  x  ;  T  < ay  + tay  a  } 

T  n„  —  a  — 

a  0 

' 

g  (k  +  1)  E  dV(£,t) 

(j+yiC<j+y+x;  c>-t) 

as  a  +  ®  through  y  +  2. 


PROOF:  It  is  evident  that  a  -  S  ,  .  -  £  ..  - ►  +  °°  since 

n  (a)  n  (a) 

—1  -1/2  u  u 
[ay  -ng(a)]a  -*■  +  «.  Thus  we  may  use  the  result  of  Lemma  2  for 

the  random  walk  0,  S  ,  v..  -  S  ,  . ,  S  /„\,0  -  S  ......  and  the 

nQ(a)+l  nQ(a)  nQ(a)+2  nQ(a) 

hitting  time  V  „  r  to  estimate  P(s,,  +  £  -a<z|3  }  : 

a-b  — t  T  n.  —  n« 

n0  n0  a  0  0 
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(34)  P(|P{ST  +  £  -  a  £z|3  }-G  *(z)|>€)^0 

Ta  n0  n0  (y-E  ) 


as  a  +  “  through  y  +  2  , 


for  every  €  >  0,  where 


(35) 


u  *  u  mod  1  for  all  u  e  R  . 


£ 

Since  £  - *■  and  £  has  a  continuous  distribution, 

no 


(36) 


EG  *  (z)  ■+■  EG  .  (z)  ; 

(y-O 


this  and  (34)  prove  (30)  since 


(37)  EG  .(z) 

(y-O 


E  (y-0  +  z  1 
e  z  g(j) 
j-i 


E z J 

z  g(j)+g( ITz+i  ])p{  E  (y-£)  +zj=  Ez+U) 
J-i 

Ez  J 

z  g(j)+g(E z+i 3)h  (z-EzJ) 
j-i  y 


Similarly  we  may  deduce  from  Lemma  2 


(38)  P(|p{St  +5  -  a  <  z  ;  t  < ap*1  +  tay“3/2  a1/2|3  } 

Ta  n0  ~  a~  n0 


-  G 


*  (z)  1  ((S  +  5  -nny)/OnJ:/2>  -t>  |  >€)  -  0 

(y-C  )  no  no  0  0 

n0 


(as  a  -*■  »  through  y  +  I) 


.  .C.  i.  J  m  1.—  A. 
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The  reasoning  is  as  follows:  the  event 


{S  +£  -a<z;  t  <a  y  1  +  toy  ^  a1^2} 

T  n.  -  a  - 

a  0 


{(Sn  +u  "  sn  )  -  (a-S  -£  )<z  ; 

n0+v  nQ  nQ  nQ  - 


v  <  (ay-1  -  nQ)  +  toy-3^2  a1^2} 


where 


(40)  v  =  v  „  r  =  min(k  :S  ,  -  S  >a-S  -  £  } 

a-S  -C  nrt+k  n.  n_  nrt 

nQ  nQ  0  0  0  0 


By  Lemma  2  and  the  fact  that  a-S  -  £  - ► 

n0  n0 

(41)  P(  (S  -  S  )  -  (a  -  S  -E  )<z; 

n0+V  n0  n0  no 


ve(a-Sn  -  E  )y  1  ±  (a-S  -E  )6|3  } 


n0  n0 


(y-Zn  ) 

no 


no  no  n0 


(z)  0  ; 


v <S  .  1/2  P 


moreover,  since  (a-S  -£  )” /n^'  *  — — *■  0,  and  a3^2/ni^2  y1^2  -*•  1, 

n0  n0  0  0 

(42)  l{  (a  -  S  -E  )y-1  ±  (a-SB  -E  )6 

n0  n0  n0  0 


<  (ay-1  -  nQ)  +  toy'3/2  a1/2} 


-  l{ (S  +  E  -  n  y)/onf' ^  >  -  t)  0 

n0  no  0  0 


This  and  (41)  imply  (38). 


■; y.**r*™  .rr_ r  ** v T" ; 
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If  we  set  z  -  +  09  in  (38),  we  obtain  (31).  Furthermore,  it 


is  clear  that  if  (7)  holds,  then  (38)  implies  (33). 

To  prove  (32)  we  choose  n  (0  < n  <  1/2)  small  enough  and  A 
large  enough  so  that  a  >  A  implies 


P{£  ,  .  e I0  }  <  € 

tig  (a)  2n 


for  every  interval  I  c  [0,1]  of  length  2p  (this  is  possible  since 

E,  and  E,  has  a  continuous  distribution).  Since  the  random  walk 

n 

(S^)  is  supported  by  2,  it  is  clear  that  (43)  implies  (32). 

Theorem  1  is  an  immediate  consequence  of  Lemmas  1  and  3. 
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